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On algebraic time-derivative estimation 
and deadbeat state reconstruction 

Johann Reger^ 



Abstract 



This note places into perspective the so-called algebraic time-derivative estimation method recently 
introduced by Fliess and co-authors with standard results from linear state-space theory for control 
' systems. In particular, it is shown that the algebraic method can in a sense be seen as a special case of 

' deadbeat state estimation based on the reconstructibility Gramian of the considered system. 

I. Introduction 

^ _ In the past few years, the algebraic approach to estimation in control systems proposed by 

^ ■ Fliess and co-workers has generated a number of interesting results for different problems of 
^ ! estimation of dynamical systems such as state estimation, parametric identification, and fault 
^ diagnosis, to name but a few (see [fTOl . [HI, |l6l, lEl and references therein). Loosely speaking, 

O 

> 



this new estimation approach is mainly based on the robust computation of the time-derivatives 
of a noisy signal by using a finite weighted combination of time-integrations of this signal. These 
results, obtained through the use of differential algebra and operational calculus [|T7l . allow to 
obtain an estimate of the time-derivative of a particular order in an arbitrary small amount of 
time S. 

Questions arise on how to relate the above to more classical results of automatic control, and 
in particular to linear system theory. The present paper contributes to this discussion by showing 
that the algebraic time-derivative estimation method, as presented in [|T8l and references therein, 
can be seen, in a sense, as a special case of previously known state-space results exhibiting a 
deadbeat property. 

^Johann Reger is a professor and head of the Control Engineering Group, Computer Science and Automation Faculty, Ilmenau 
University of Technology, RO. Box 10 05 65, D-98684 Ilmenau, Germany (e-mail: reger@ieee.org). 
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After this introduction, we briefly recall in Section |II] the main results of the algebraic time- 
derivative estimation method. Then, in Section Hill we recall a few results of linear observability 
theory and show how in particular the reconstructibility Gramian can be related to the algebraic 
method. We end this paper with a few additional remarks on how to relate further extensions of 
the algebraic approach with different areas of control systems theory. 

II. Algebraic time-derivative estimation 

The algebraic derivative estimation techniques have been presented in various styles and 
frameworks, mostly based on abstract algebra and operational calculus. Because of its practical 
interest, we recall here only the main result for a moving-horizon version of the approach (see 
ifTSl and II3TI ). However, note that the results shown in the present paper would also be very 
easily applicable to earlier expanding -horizon versions that can be found in [4J or [lOJ. 

Consider a real-valued, A^-th degree polynomial function of time 

N 

a 



i=0 



where the terms are unknown constant coefficients. The goal is to obtain estimates of the 
time-derivatives of y{t), up to order A^. 

In Hi, [m, [fT9ll . Fliess and co-workers proposed to do so by, roughly speaking, resorting to 
algebraic combinations of moving-horizon time-integrations of the available signal y{t). Let us 
briefly recall these results in the following theorem ifTSl . ll3T1l . 

Theorem 1: For all t > T, the j-th order time-derivative estimate y^^\t), j = 0, 1, 2, . . . , A^, 
of the polynomial signal y{t) as defined in ([T]) satisfies the convolution 

y^'\t)= f Hj{T,r)y{t-r)dT, j = 0,l,...,N (2) 

where the convolution kernel 

^) = TN+3+1 



TN+j+i ^j^2!(A^-J-/ti)!(j-«:2)!(A^-/ti-/t2)!(/ti + /t2)!(A^-«:i + l) 

(3) 

depends on the order j of the time derivative to be estimated and on an arbitrary constant time 
window length T > 0. □ 
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For the interested reader, as well as for the sake of completeness, a way to derive the results 
of Theorem [T] is given in Appendix A. 

Thus, considering for example the degree-one polynomial 

y{t) = ao + ait (4) 

applying Theorem [T] would simply give us the following first-order time-derivative estimate 

ij{t) = Y^{T-2T)y{t-T)dr. (5) 

The effect of the time-integration is obviously to dampen the impact of the measurement noise 
on the estimate. Note that this feature can also be used to filter out noise from the signal y{t) 
itself, as the zero-order time-derivative estimator would be 

y(t) = ^ ^{2T-^r)y{t-T)dT (6) 

as obtained, once again, from Theorem [TJ 

in. From deadbeat reconstruction of the state to the algebraic method 

As will be seen, the above may be related in several ways to more traditional results of 
classical linear control theory. To do so, consider now the following linear time-varying system 

x(t) = A(t)x(t) (7) 
y{t) = C(t)x(t) (8) 

where x(t) G M^+^ and y{t) E M. Note that while the form of system dV])-® was chosen for the 
sake of simplicity and ease of presentation, the discussion of the present section is extendible 
to systems with multiple inputs and outputs. 

Then let us briefly recall a few elements pertaining to the notion of state reconstructibility fTri, 
ttD, [l20l . As noted in Willems and Mitter ll30l . this property has been quite overlooked in the 
control literature, possibly because of its equivalence with observability for linear continuous- 
time systems. Loosely speaking, we say that system ©-([8]) is reconstructible on [to,i^i] if 
can be obtained from the measurements y(t) for t E [to,ti]. 

A standard way of determining x(ti) can be obtained by first writing the following expression 
for the output 

y(r) = C(r)$(r,ti)x(ti) (9) 
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where $(t, t) is the transition matrix of (|7]). Then, left-multiply and integrate ^ to get 



ii 



^'{r,t,)C'{r)y{T)dT= ( / (r, ti) (r) C(r) $(r, ti) t^r x(ti) (10) 

Since in eq. (flOl) x(ti) is a constant term with respect to the integral, it can be isolated, and we 
finally get, for an estimate x(ti) of x(ti). 



±ih):=W;\to,h) $^(r,ti)C^(r)y(r)t/r (11) 

where 

W,(to, h)= ^^{t, h) CT(r) C(r) $(r, ti) rfr (12) 

is the reconstructibility Gramian. 

In treatments of observability in textbooks, developments such as the above are mostly used, 
through the observability counterpart of (fT2l) . to check whether a system is observable (resp. 
reconstructible) or not. However, as noted in ^ p. 158] for the observability case, expression 
(fT2l) can also be used to actually compute x(ti) as integration will smooth out high-frequency 
noise. 

The above results are well-known, even if not as much used for state estimation as linear 
asymptotic observers are. But the former has the interesting property of allowing to give an 
estimate of x(ti) in definite time, whose value is decided by the invertibility of ([T2)) . 

Interestingly, these two features of the above Gramian-based estimation - deadbeat property 
and time-integration, coincide with those of algebraic time-derivative estimation. 

Let us push the comparison a little further in a simple way by first noticing that the degree-one 
polynomial dH) can be put into state-space phase-variable form with matrices 

A=|°^|, C=(10), (13) 





state x(t) = {y{t),y(t))^ and initial conditions x(0) = {ao,ai)^. 

Then, compute an estimate of x(t) using (fTTI) and (fT2l) . To do so, use the fact that the matrices 
in (fT3l) are time-invariant and that = to obtain 

/ 1 T 

(14) 
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which implies that 



C$(r,ti) 



Letting to = t - T (with T > fixed) and ti 
Gramian 

W,{t-T,t) = 



1 r-tij . (15) 
= t, we then obtain from (fT2l) the following 

(16) 



T 


rp2 




^3 


2~ 


~3~ 



x(t) 



y(r) rfr, 



(17) 



which in turn is used, in combination with ([TT]) . to get 

Hence, similarly to the previous section, an estimate of the derivatives of a degree-one polynomial 
can be obtained with time-integrations of the measured signal, albeit this time using tools from 
classical control theory. 

Note, interestingly, that in this particular example, there is more than a mere similarity. Indeed, 
after a simple change of variable a = t — t m (flTI) . we find exactly the same expressions as ([5]) 
and 

The above second-order case can be generalized to obtain the j-th time-derivative of any 
polynomial simply by specializing A(t) and C(t) in ([T])-® to get a state-space description of 
polynomial ([I]), which yields, in phase-variable form the + 1 square matrix 



A 



10 

10 

1 







(18) 



and the + 1 row vector 



C 



1 







(19) 



associated to the state vector x(t) = {y{t),y{t), ...,y^^\t), y^^\t))^. 

After several steps in line with the previous second-order example, we obtain, similarly to 
Section |IIl an expression of the j-th time-derivative of a polynomial signal ([T]) based on the 
reconstructibility Gramian. This is summarized in the following theorem. 
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Theorem 2: For all t >T, the j-th order time-derivative estimate y^^\t), j 
of the polynomial signal y(t) as defined in ([T]) satisfies the convolution 



y^'\t)= I G,{T,a)yit-a)da, j = 0,l,...,N 
Jo 



0,1,2,. ..,N, 



(20) 



where the convolution kernel 



Gj{T,t) 



(iV+j + 1)! 



N 



[-l)\N+k + l)\ /a 
T^+ij\(N-j)\ ^ (j + k + l){N-k)\{k\y \T 



-ill ^ 



(21) 



depends on the order j of the time derivative to be estimated and on an arbitrary constant time 
window length T > 0. □ 

Proof: In the main, the proof is based on obtaining a closed-form expression corresponding 
to equations (fTTI) and (fT2l) for the particular case with matrices (fTSi) and (fT9l ). 

Since this system is LTI, the corresponding transition matrix results from the matrix exponen- 
tial of i.e. 

fl t e/2 t^Q ■■■ t^/N\ 
1 t 
1 t 



..At 




yO 
which is then used to obtain the state-transition matrix 



t^-V(Ar- 1)! 



t^-V(iV-2)! 



(22) 



(23) 



Consequently, the entries of the (A^ + 1) x (A^ + 1) reconstructibility Gramian matrix (fT2l) read 



to 



dr 



(24) 



In view of (fTTj) . the inversion of this Gramian is required. Its entries are provided in closed-form 
by Lemma \T\ in Appendix B, that is 

r^-n i^-l)\iJ-l)\i^+J-l) ( N + ^ \( N + j \(^+J-2y 

Hence, by using eq. (l25l) regarding the particular form of the transition matrix (l23l) . the {i + l)-th 
component of x(t) follows from eq. (fTTI) 



^■4+1(^1 



h N 

to j=o 



{to,ti)^—^y{T) dr. 



(26) 
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In other words, the j-th time-derivative estimate of y(t) at time t = ti can be obtained from the 
convolution 

y'~^\t,)= G,{h,to,T)y{T)dT, j = 0,l,...,iV (27) 



where 



A receding-horizon version of equation (|27l) can then be obtained as follows: Let to = t — T 
(with T > fixed), and ti = t. Proceed then to the change of variable a = t — r to obtain (|20|) 
and (|2T1) . which completes the proof of the theorem. ■ 

As might be expected from the above discussion and the second-order example, it is possible 
to show an equivalence between the algebraic estimator of Section |Il] and the one of Theorem 
[21 and this for all A^. We make this statement precise in the following theorem. 

Theorem 3: Let Hj(T,T) and Gj{T,T) be defined as in ^ and (|2T]) . respectively. Then for 

T > 0, r G [0, T], and G {0, 1,2,.. .} 

H,iT,r) = G,iT,T), J G {0,1, 2,..., AT}. (29) 

□ 

Proof: Theorem [3] follows from Riesz' representation theorem [|22ll . which states that for 
every continuous linear functional / on a Hilbert space H, a unique p E H exists such that 

fiq) = {p,q) ^qen, (30) 

where (. , .) denotes the inner product on H. 

In order to prepare the ground for applying this theorem, first note that for parameter T > 
fixed, the expressions Hj(T,T) and Gj{T,r), given by ^ and (|2T)) . are polynomials in r of 
degree A^. For t fixed, furthermore y{t — T) is a polynomial in r of degree A^ which in view of 
(dl) consequently spans H-n, i-C- the Hilbert space of degree A^ polynomials equipped with the 
real-valued inner product 

{p,q) := p{T)q{T)dT, p.qeTiN- (31) 

^0 
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Hence, for T > fixed, Hj{T, r) G Hn and Gj{T, r) G Hn- Moreover, letting g(r) := y{t - r) 
with fixed t >T we have that q eHn- 
In accordance with ([21) and (|20l ), let 

/H,(g):= r H,{T,T)q{T)dT (32) 

^0 

and 

/G,(g):= / G,(T,r)g(r)rfr (33) 

forj = 0,l,2,...,iV. 

Consequently, Theorems [T] and [21 imply that for any q E Hn 

fH,{q) = fGM^ j = 0,l,2,...,iV. (34) 

Since Hj{T,T) G Hn and Gj{T,T) G T^at, for T > fixed, the uniqueness of p in Riesz' 
theorem shows that 

H^{T,T) = G,iT,T) (35) 

for j = 0, 1, 2, . . . , A^, under the assumptions of Theorem [3l ■ 
Note that other proofs of the previous theorem are also possible. For example, a somewhat more 
component- wise proof, based on modem computer algebra proof techniques [[291 , is presented 
in [[271 by showing specifically how the terms in (O relate to those of ([2T[) . 

IV. Additional remarks 

In addition to the main result of Section [Hi Fliess et al. proposed several extensions or 
modifications, several of which having also connections with different areas of control systems. 
Let us briefly consider some of them in the few following remarks. 

For instance, note that an expanding-horizon version of the algebraic method was first intro- 
duced in [f9l, which would correspond to let to = and ti = t in the reconstructibility Gramian 
perspective. In this case, an equivalence similar to Theorem [3] can still be obtained. Furthermore, 
note that, interestingly, letting S(t) := Wi.(0,t), and differentiating respectively S(t) and the 
product S(t) x(t) with respect to time using a few standard manipulations, we obtain 

S(t) = -A^{t)S{t) - S(t)A(t) + C^(t)C{t) (36) 
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and 

m = (A(t) - S-\t)C^{t)C{t)) m + S-\t)C'^{t)y{t) (37) 

which draw similarities with the information form of the continuous-time Kalman filter 
lfT2l for system ([T])-® with additive noise v{t) E M of identity covariance, R = I, on the 
measurement equation ([8]). This in turn shows that, thanks to a simple modification of Theorem 
|3] for expanding horizons, links with optimal estimation could be obtained even though the 
derivations and motivations for the algebraic method are clearly different (see in particular ||9l). 

As another example, one could also consider identification problems, and parallels to the work 
of Fliess and Sira-Ramfrez [SJI on identifying linear systems using the algebraic method. Indeed, 
replacing ©-dS]) with 

cp(t) = (38) 
y{t) = iv^{t)ip (39) 

where cp is a constant parameter vector to be estimated, introduce, similar to Section Hill the 
Gramian-based receding-horizon estimator 



(p{t)=W;\t-T,t) [' a){r)y{T)dr 

Jt-T 



(40) 



with 



W,{to,h) = / iV{T)uj'{T)dT (41) 



to 

which is reminiscent of the well-known condition for persistent excitation (see for example [[T3l . 

ini, mx 

In an other extension presented in |fT9l , the authors propose to further reduce the impact of 
measurement noise on the estimates by using additional integrations. This is also possible with 
the Gramian point-of-view as both sides of (flOl) can easily be time-integrated several additional 
times with respect to to, as opposed to only once to obtain x(ti) - in fact, even filter operations 
with respect to the variable to can be applied on both sides of (fTOl) . so as to generate a variety 
of further estimators. Once again, an equivalence between this result of the algebraic approach 
and a particularization of a reconstructibility perspective can be obtained. More generally, we 
can for example insert in (flOl) another kernel A(r, to) as follows 

x(ti) ■.= W-\to,h) [\{T,to)^^{r,ti)C^{r)y{T)dT (42) 

J to 
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where 

WA(to, h) = [ \{r, to)$^(r, h) CT(r) C(r) $(r, dr, (43) 

J to 

this to obtain the desired response with respect to measurement noise. 

Finally, and although it is clearly beyond the scope of the present paper, note that because of 
the convolution form of algebraic estimation Q, the latter can also be connected with Finite- 
Impulse Response (FIR) differentiators, on which numerous studies and results were published 
(see lfT4l . [|27ll and references therein), with the minor difference that these differentiators are 
usually described in a discrete-time framework, although it is clear that a comparison similar to 
the present paper could also be carried out in discrete-time. 

In particular, it might be of interest to compare the latest extension of the algebraic estimation 
approach, where time-delays are considered to improve the results, together with FIR differen- 
tiator designs considering the same issue that have been proposed over the past few years (see 
for example [28] and ll23l ). 

Acknowledgments 

The authors would like to express their gratitude to the associate editor, as well as to the 
anonymous reviewers, whose comments and suggestions were very helpful in improving the 
present paper. Johann Reger thanks Peter Caines and Jessy Grizzle for valuable discussions. The 
work of Johann Reger was supported by fellowships of the German Academic Exchange Service 
(DAAD), grant D/07/40582, and partially, by Max Planck Institute for Dynamics of Complex 
Technical Systems in Magdeburg, Germany. 



December 25, 2008 



DRAFT 



11 



Appendix 

A. Proof of Theorem [7] 

The following proof resorts to standard techniques from operational calculus. To this end, we 
rephrase eq. ([T]) in the Laplace domain as 



N 



i=0 ^ 

where the coefficients are identified with ^''^•'(O). In order to single out a particular term, 
?/(j)(0), first multiply dSl) by s^+\ 

N 

.^+^r(.) = 5^y«(0).^-\ (45) 

which results in a polynomial form in s on the right side of (l45l) . To eliminate the terms 
y(i+i)(0), . . . , ?/(^)(0), differentiate (l45l) N — j times with respect to s (see |I3 for a first 
presentation of the idea). This yields 

^ = ±y'm . (46) 

In the next step, we proceed to a similar treatment to eliminate the remaining constant terms 
?/(°)(0), i/^^^(0), . . ., y'-^'^\0). But before doing so, premultiply (061) by 1/s, that is 

ii^(.-r(.))^ (^,»(0) + ^,<^mi^s'-'-^ (47, 

which is done to prevent y^^\0) from cancelation due to a j-fold differentiation with respect to 
s. Indeed, the latter operation finally gives 



This equation could readily be transformed back into the time domain. However, the left side 
of (l48l) contains the monomial s^, i.e. an A^-fold differentiation with respect to time in the time 
domain, meaning if a high-frequency noise is corrupting y{t), the former would be amplified 
as a result. Note that a similar idea can also be found in ll26i p. 17-1 8]. In order to avoid the 
explicit use of these time derivatives, premultiply (l48l) with l/s^"*"^, thus implying that y(t) will 
be integrated at least one time. Therefore, we obtain 
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where it can been seen that the term y^^\0) depends only on a finite number of operations on 
the signal Y{s), as shown in [HEl, [|3ll. 

Before performing the backward transform into the time-domain, rearrange the left side terms 
of (|49l ) using Leibniz' formula for the differentiation of products twice. This results in 

1 fl ci^-^- , ^^1,,, ,A ^ ^ fN-j\f J 



Y{s) (50) 



which, in view of the right hand side of (l49l) . implies in turn 

1 (-1)^' ''x^^fN-3\f3 



(A^+1)! 1 



Kl=0 K2=0 



(51) 



(A^-Ki-Ks)! (iV-Ki + 1) s''i+''2+i rfs^-''i-«2 
Eq. (|5TI) is now transformed back into the time domain. Using the following inverse Laplace 
transform formulae 

(t-rn-ry 



£ 



' 1 d^ 













we obtain 



with 



-1 



ft 



y{r)dr (52) 



y^^^{0)= H,{t,T)y{T)dT, j = 0,l,...,iV (53) 







i/,(i,r)=(^^±i±iP^±Wzl)!x 

«:i!/t2!(iV-J-«:i)!(j-«:2)!(iV-/ti-/t2)!(«:i+/t2)!(iV-/€i + l) 

The results obtained above thus give an estimate y^^\t) at time t = from the polynomial signal 
y, see ([U), taken on the interval [0,t]. In order to get a moving-horizon and causal version of 
these results, first replace t with — T, where T is a positive constant flU, jSl and simplify using 
the fact that 

(-1) H,{-T,-t) = i-iy Hj{T,t) (55) 
Finally, by shifting the ^/-values by t. Theorem [T] is immediate. ■ 
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B. Lemma for the Proof of Theorem |2] 

Lemma 1 (Inverse of Wj.(to, ti)): Let the entries of the matrix Wi.(to) ^i) be given as in (|24l) . 
The entries of its inverse are 

□ 



{ti - toy+^-^ \N+l-jJ\N+l-iJ\ i-1 



Proof: In light of equation (l24l) . first, left- and right-multiply W^(to,ti) with a diagonal 
matrix M whose entries are 

= (l^^.. (57) 

where 5ij is the Kronecker delta. Then, proceed with computing the following matrix product 
in component form as 

N+l N+l 
k=l 1=1 

= — ^ (58) 

whose result can be recognized as the entries of an (A^ + 1) x (A^ + 1) Hilbert matrix, hereafter 
denoted H. The entries of the inverse of H are known to be [|25l 

and by computing 

W7i(to,ti) = (ti-to)MH-iM (60) 
we obtain (|25]) . which completes the proof of the Lemma. ■ 
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